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ABSTRACT 

The  hypothesis  that  Shannon's  full-channel  information  capacity 
can  be  approached  only  in  a  communications  system  employing  both  ampli- 
tude and  phase  modulation  (AM  and  PM)  is  the  basis  for  this  thesis. 

Phase  modulation  is  discussed,  PM  and  AM  systems  are  defined  and 
AM  and  PM  are  combined  into  a  single  system.   Error  probability  formulas 
are  derived  and  applied  to  the  system  in  the  presence  of  carrier  fading 
and  Gaussian  noise. 

Cyclic  codes  are  introduced  and  discussed  in  detail.   A  cyclic  code 
is  selected  for  the  system  described  above  and  its  implementation  and 
effect  on  the  error  rate  of  the  system  are  described. 
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1.   Introduction. 

In  a  paper  comparing  the  information  capacities  of  amplitude  and 
phase  modulation  communications  systems  F  lj  ,  N.  M.  Blackman  concludes 
that  the  Shannon  full-channel  capacity  can  be  obtained  only  in  a  system 
employing  both  AM  and  IM.   Blackman' s  conclusion  is  based,  in  large  part, 
on  probability  and  statistics  and  is  quite  analytical.   This  thesis  is 
an  attempt  to  exploit  Blackman1 s  conclusion  by  proposing  a  combined  AM- 
PM  system  and  evaluating  such  a  system  under  conditions  of  noise  and 
carrier  fading.   Error  probabilities  and  coding  will  be  studied  in 
detail.   It  is  intended  that  this  thesis  proceed  from  theory  to  the  de- 
scription and  analysis  of  a  reasonably  practical  communications  system. 

In  Section  2,  phase  modulation  is  discussed.   The  Fourier  Transform 
Identity  is  used  to  represent  a  data  wave  modulating  a  carrier  by  means 
of  a  product  modulator.   The  output  of  this  modulator  is  a  signal  con- 
taining frequency  components  in  a  band  centered  at  the  carrier  frequency 
and  equal,  in  width,  to  twice  the  maximum  modulating  frequency.   The 
maximum  modulating  frequency,  of  course,  is  determined  by  the  highest 
frequency  component  in  the  data  wave.   During  transmission,  it  is  assumed 
that  the  signal  undergoes  changes  in  amplitude  and  phase  due  to  the  char- 
acteristics of  the  transmission  medium.   At  the  receiver,  the  signal  is 
product  demodulated  by  a  reference  signal  identical  with  the  original 
carrier  shifted  in  phase  and  attenuated  by  the  transmission  medium.   With 
certain  assumptions  on  these  characteristics,  it  is  shown  that  the  orig- 
inal data  wave  is  obtained  at  the  receiver,  modified  only  in  amplitude. 
That  is,  the  phase  information  has  been  preserved  in  transmission. 
Therefore  phase  information  is  conveyed  using  only  product  modulators  and 
demodulators. 


In  Section  3,  the  theory  of  the  preceding  paragraph  is  applied  to 
the  IM  system.   A  converter  is  described  which  changes  the  digital  (  0 
or  1  )  information  into  a  sinusoid  at  a  given  frequency  and  at  a  phase 
(  0  or  180   )  which  is  determined  by  the  state  of  the  bit.   This  sinus- 
oid, then,  becomes  the  data  wave  treated  above  and  is  used  to  modulate 
the  carrier.   After  transmission,  the  modulated  carrier  is  product 
demodulated  and  filtered  and  fed  into  a  converter  in  which  the  origi- 
nal bit  is  restored.   Further,  it  is  shown  that  two  bits  may  be  trans- 
mitted at  a  time  by  having  one  modulate  a  carrier  as  above  and  the 
other  modulate  a  carrier  whose  phase  differs  by  90   from  the  original 
carrier.   Demodulation  is  the  same  except  that  the  carrier  is  shifted 
90  before  it  is  inserted  into  the  product  demodulator  for  the  second 
bit.   By  means  of  phasors,  it  is  shown  that  each  bit  may  be  recovered 
in  a  manner  identical  with  that  described  above  for  a  single  bit. 

In  Section  4,  an  AM  system  is  discussed.   Because  AM  is  covered 
quite  thoroughly  in  textbooks  and  in  the  literature,  there  is  no  dis= 
cussion  of  AM  theory.   Instead,  two  systems  are  described  briefly,,   The 
amplitude  of  the  carrier  has  two  possible  values,  the  amplitude  being 
determined  by  the  state  of  the  bit.   The  first  means  of  obtaining  AM  is 
a  variable  gain  amplifier  (VGA).   An  example  of  a  VGA  is  a  vacuum  tube 
in  which  the  carrier  is  applied  to  the  control  grid  and  the  data  wave 
is  added  to  the  DC  plate  or  screen  supply  voltage.   Another  AM  system 
is  referenced  but  not  described.   It  is  the  "A-l  Data  System"  developed 
by  the  Bell  System  in  which  the  data  wave,  basically,  amplifies  the  car- 
rier by  an  amount  dependent  on  the  state  of  the  bit.   In  either  case,  an 
envelope  detector  must  be  used  in  conjunction  with  a  threshold  device  to 
detect  the  state  of  the  bit  transmitted.   Specific  values  of  the  ampli- 
tude levels  are  discussed  below  in  connection  with  error  rates  (Section  8). 
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In  Section  5,  methods  of  combining  the  AM  and  EM  schemes  into  a 
single  subsystem  are  discussed.   Further,  the  possibility  of  frequency- 
division  multiplexing  (FDM)  several  of  these  subsystems  is  proposed  and 
discussed  briefly.   Basically,  an  AM-PM  subsystem  operates  on  three 
bits  at  a  time.   One  of  these  bits  is  handled  by  AM  and  the  other  two 
bits  by  PM.   A  semi-analytical  approach  is  taken  to  outline  the  possi- 
ble states  of  the  system  and,  a  signal  space  is  indicated  for  an  AM-PM 
subsystem.   Finally,  five  subsystems  are  combined  using  FDM  and,  for 
the  first  time,  provisions  are  made  for  error  detection  and  correction 
(EDAC) . 

In  Section  6,  the  error  probability  for  the  AM  system  is  studied. 
Gaussian  noise  is  assumed  along  with  carrier  fading  described  by  the 
Rayleigh  distribution.   As  a  first  pass  at  the  error  probability,  it 
is  assumed  that  there  is  no  carrier  fading  and  an  equation  for  the  prob- 
ability of  a  detection  error  is  derived.   This  equation  is  a  function  of 
signal  to  noise  ratio  (R) ,  relative  threshold  level  (a)  and  relative 
signal  level  (k)  applied  in  the  error  function  (erf)  often  referred  to  as 
the  probability  integral.   Next,  carrier  fading  is  assumed  present  and  a 
similar  derivation  leads  to  an  equation  for  error  probability.   Finally, 
an  optimum  value  of  the  threshold  level  is  obtained  as  a  function  of  the 
relative  signal  level  and  noise  level. 

In  Section  7,  the  error  probability  of  the  FM  system  is  studied. 
Noise  and  signal  phasors  are  used  to  analyze  phase-modulated  communica- 
tions systems  including  the  case  of  a  system  subject  to  carrier  fading. 
Equations  for  error  probability  are  obtained  and  are  seen  to  be  depend- 
ent upon  the  same  variables  as  the  AM  system  above. 

In  Section  8,  the  results  of  the  two  preceding  paragraphs  are 
combined  for  the  AM-PM  system.   Equations  for  the  probability  of  one, 


two  or  three  bits  in  a  group  being  in  error  are  obtained.   The  computer 
program  for  error  probability  calculations  (see  appendix)  is  discussed 
and  comments  concerning  the  program  output  are  made.   Again,  the  problem 
of  selecting  a  relative  signal  level  is  attacked  and  results  tabulated 
for  several  signal  to  noise  ratios.   Finally,  the  effect  of  FDM  on  error 
probability  is  discussed. 

In  Section  9,  cyclic  coding  theory  is  introduced.   Cyclic  coding 
was  chosen  because  the  same  or  similar  codes  may  be  used  in  the  system 
regardless  of  the  number  of  subsystems  which  are  multiplexed  together. 
Polynomial  representation  of  binary  information  is  discussed  and  princi- 
ples and  theorems  of  cyclic  coding  theory  are  stated.   Finally  a  specif- 
ic code  is  selected  for  the  system.   The  code  is  applicable  to  a  message 
containing  up  to  eleven  information  bits  and  four  EDAC  bits,  will  correct 
all  single-bit  errors  and  will  detect  over  90%  of   any  type  of  error  in- 
cluding multiple  burst  errors.   A  means  of  implementing  this  code  is 
presented  and  described. 

The  last  sections  draw  conclusions  from  the  thesis  and  make  recom- 
mendations for  further  study  of  the  AM-FM  Digital  Communications  System. 

An  appendix  is  included  giving  error  probability  calculations  out- 
lined above. 
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2.   Discussion  of  Phase  Modulation  (PM) . 

It  will  be  shown,  in  this  paragraph,  that  a  product  modulator  is 
suitable  for  phase  modulation  purposes. 

A  product  modulator  forms  the  product  of  two  signals,  a  data  wave 
(signal)  and  a  carrier  wave.  The  data  wave  carries  the  information  to 
be  transmitted  and  the  carrier  wave  transmits,  or  transports,  the  data 
wave  to  some  other  point.   Let  the  signals  be  denoted  as  follows: 


s(t) 

cos(ujc-£  +  &) 


Data  Wave 

Carrier  Wave 

Product  Modulator  Output 
By  the  Fourier  transform  identity,  s(t)  may  be  represented  as  follows 
where  (*>i.   is  the  maximum  (limiting)  modulating  frequency: 

SCt)  r  ^L  J  5  (uj)  cos  (ol>^  +<&(0J))  Joo 

a 

The  modulator  output,  \*(t)  ,  is: 

X^  (•£)  -  s(t)  cm  (  vJc*  +  e) 


I    ( 

zjf      S(^)  c*^(uzt+  e)co^(tu^  +  $(uj))  J.UJ 


At  this  point,  the  symmetry  of  S(u>)  and  $(ou)  should  be  considered. 
Let  the  Fourier  transform-mate  of  s(t)  be  denoted  by  F  toS)  .   Therefore, 

In  Fourier  transform  theory,  it  is  required  that 


li 


where  (*)  denotes  the  complex  conjugate.   Therefore, 

This  equality  requires  that: 

,$("" uJ)  —    5  C^)   s0  that  „5  (OOj  is  an  even  function 
(£>(-Ll>):=  —<fi(U))     so  that  <^^)  is  an  odd  function 

Next,  the  trigonometric  identity  indicated  below  will  be  applied  to 

the  equation,  above,  for  Xft). 

o 


oj     -      uu'-   ^c 

c<^  (-x)    =  c*>-^  (x) 
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uJt-f  OJL 


X/wiW  -  Jtf.  JM^'-^c)  w[o>'*-f  8   +  ^<>'-u/c)]<Jlco 


t/Jc 


U>t 


LPc-LJL 

To   indicate   that   this    is    the   transmitted   signal,    let  \,(t)    become  X    (t) 
and   combine  both   terms  under   the   same   integral  with  00  in  place   of   w'  . 

LDc4LdL 

KrW=  Jff  jS(u)-a>c)c^^[a;^  -/-  Q  -h  <f>  Cuj-  uJc)J  Ji  co 

During  transmission,  the  signal  will  be  changed  in  amplitude  and  phase 
due  to  the  medium  of  transmission,  noise,  etc.   Let  the  amplitude  change  be 
denoted  by  a(u))   and  the  phase  change  by  &(u>)  .   This  phase  change, 
along  with  phase  slope  due  to  tuned  circuits  in  the  receiver,  will  lead 
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to  a  time  delay  in  the  reception  of  the  signal  so,  for  a  first-order 
approximation,  assuming  a  dispersive  medium  ,  let  P  be  treated  as  fol- 
lows. ~  /^  /  V 

-   (3  (  uic)   —  cT  ^  ' 
where  ^  is  a  constant  time  delay. 
The  signal  arriving  at  the  receiver,  X  (t)  is: 

K 

This  signal  will  be  demodulated  by  beating  it  with  the  local  oscillator 

signal  given  below: 

X    =  cos  f  ou>0-fc  +   </0 
osc        \   w       '  • 

where  lp     is  the  phase  of  this  reference  signal. 
In  an  actual  receiver,  y      would  be  automatically  adjusted,  by  means  of 
circuitry,  to  obtain  and  maintain  carrier  phase  lock. 


Th 


e   output    from   the   demodulator,    X^(t),    is: 


0Jc-uJL 


OJc-  UJL 
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u>c^u>2. 


Le.±        P    =     ©  +    @  t<^c) 


60        "=-    6U  ;—  UJ  q. 


JLUJ        B      J.UJ    ' 


—  CJ, 


4    ptu/Oj   ^Luj  ' 


^M^r      *olo*+t+o  +  i>*?        ^    =    S4-Q(uJ^) 
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The  first  integral  represents  a  signal  with  frequency  components  cen- 
tered about  the  second  harmonic  of  the  carrier  and  will  be  removed  by 
means  of  a  low-pass  filter.   In  the  second  integral,  assume  that  A(LO'   ) 
is  constant  in  the  frequency  band  centered  at  the  carrier  frequency  so 
that  the  integrand  is  an  even  function.   Therefore,  the  output  from  the 

filter,  X  (t)  is  given  by: 

"*  L 

LcH-mj        Q  (to  ')    -     ~    i0jf       rt    S      cti$CO&$<er/      *  ko\J  C  j 

X0  L± )  =  j;^  J  n  c    i>)  tjchb^uoH,  -t  0(uj)  —  uj  £ ]JLuj 

This  is  identical  with  the  original  data  wave,  s(t),  modified  in  ampli- 
tude and  delayed  so  the  phase  information,  denoted  by  0(cO),  has  been 
transmitted. 

In  conclusion,  it  should  be  noted  that  the  assumption  that  A(  u)  )  is 
constant  and  the  definition  of  0(60)  are  not  valid  in  all  cases.   For 
example,  multipath  effects  would  require  a  different  treatment.   Also, 
an  interfering  signal  would  disturb  the  received  wave  form  and  could 
cause  much  phase  information  to  be  lost  in  this,  as  well  as  nearly  any 
other,  communications  system. 
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PftOA 
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X*60    J 

L  P 
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Xote) 

■  i        ja 
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T 
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M  f  y) 


^  (■*)  — > 


Xote)  =  ^-/i  *(*-</) 


Figure  1.  A  Phase  Modulation  Model. 
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3.    A  Phase  Modulation  Demodulation  System. 

In  the  foregoing  paragraph,  it  was  shown  that  phase  information 
could  be  conveyed  in  a  model  in  which  the  MODEM  consisted  of  product 
modulators  (demodulators)  and  filters  when  the  data  wave  was  a  signal 
with  some  phase  angle,  cos  (  ^>t  +   0) .   To  apply  this  to  a  digital  com- 
munications system,  we  need  some  slight  additions  to  be  described  be- 
low.  Since  our  data  is  a  series  of  O's  and  l's,  we  need  a  converter 
which  will  accept  these  and  generate  cos  (  ^t  +  0)   where  0  has  one  value 
if  the  data  is  1  and  another  if  0. 

Ti  Ancl  4x    Are  de-tarwiflec/ 


a  fci+s 


COA/V. 


^(oJ^-fc-r^) 


bu  l&   »nd      A**      feifj 


res  pec 


-h\/e  I  u  . 


Figure  2.   Converter. 
This  converter,  consisting  primarily  of  an  oscillator,  phase  shifting 
networks  and  delays,  converts  the  binary  datfc<  to  sinusoidal  data  waves 
and  delays  the  first  bit  so  that  both  output  waves  start  at  the  same 
time. 

The  modulator  will  be  denoted  as  follows. 


(i) 


■*•  XM0t)  =  lT(i) 


Figure  3.   Phase  Modulator. 


^L-t)   =  Goo  (oJ-n-t  +  4>   ) 
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1^=0 


XmiW  =:f  [<^jj>c-h>>m)-£  +  ©j]+^^[(^c-^^)t  +  ©i]^ 


,4    <*>  =  >so< 


XMo(*)=^[«^[i^+Hii)t+©,^/^  +  ^(^-^»«)t+el-/«o0]J 


S  I  ACS      C>©-6  (.  *  ±.   1*0°)    =  -  c/>-6  (x) 


Y/ttO  W-   -^  [^[(oJc  +  U^)*  ■*-©,]  +  C^[(W6-(*^)4  -f  ©Jj 


\     Xmo^)=  -Kmi(±) 


This  implies  that  letting  0  be  0  when  that  data  is  a  1  and  180  when  it 
is  a  0  requires  only  that  polarity  be  detected  in  the  receiver. 


*A&)       w 

o 

*T* 

W 

/- 

r    /^\ 

, 

~*(J»C>0J~rt 

Go* 

\ 

os>c 

. 

J 

AtL 

A    ferff/0 

Co^Js/ 

G»AUfe.-£ 

Summer 

B 

T^ 

1 

i 

i 

±CMOVit 

?0°    PKrtse 

Xts  (-fc) 

ooo(o 

r 

<*»Gri 

P    ^ 

r      ^ 

Figure  4.   Four-phase  System  (Modulator). 


19 


Consider  the  system  shown  in  figure  4.   The  signals,  s.(t)  and  s  (t)  can 


each  be  either  cos  ( w  t:)  or  cos  ( *  t  +  180  )  depending  on  whether  A  an 


m 


m 


B,  respectively,  are  1  or  0.   The  signal,  X  A(t),will  have  a  phase  angle 
of  either  0  or  180°  but  due  to  the  90°  shift  in  the  carrier,  X__.(t)  will 

Id 

have  a  phase  angle  of  either  +  90  or  -90  .   The  transmitted  signal, 


XT(t),  is  a  vector  sum  of  X _.(t)  and  X^Ct).   The  operation  of  the  sysr 

1A  lb 


tern  is  most  clearly  seen  by  looking  at  phasors. 


Kta  (-0 


XtW 


XtB  (t) 


B  = 


V    B  =  Q 


or : 


A=  / 

A-  / 

A-o 

A  =  o 

B  -/ 

Q  =o 

e  -I 

Q=0 

oi     ^? 

yn 

'      \ 

/ 

\ 

/ 

0O     £ 

^|0 

;?  ©  p  en    ^      £  r-a  ^l  (o  r- 
Cgc|»c)   code, 


Figure  5.   Phasors  for  the  Four-Phase  System. 
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The  next   item  is  a  demodulator. 


x*a) 


UM 


V'-pCwO+e., 


?(IOOUCT 

— T — 

Figure  6.   Phase  Demodulator. 

Recall  that  X  (t)  is  the  same  signal  as  X  (t)  except  that  it  has  been 
K  1 

delayed  due  to  the  velocity  of  propogation  in  the  medium  and  the  char- 
acteristics of  the  tuned  circuits  in  the  receiver.   The  amplitude  change 
will  not  be  included  or  considered  here  but  will  be  considered  in  later 
paragraphs  dealing  with  amplitude  modulation.  When  the  data  wave  is  a 
sinusoid: 

Xo£i)  =   XrU)  c/k>(^c**V) 


fl  r 
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This  constant  can  be  used  to  break  X  (t)  up  into  its  A  and  B  components 

R 


by  making  (9   -9   )  =0  or  +  90°  . 


kit) * 


"I 


Xd/»C^) 


>     LP 


0  sc 


A 


?£' 


Xo*W 


COKIV 


&    P/M 


W), 


£s«-.    L.  P 


4>A 

8 


XofiC-t) 


Figure  7.   Four  Phase  System  (demodulator). 

The  demodulation  action  is  most  clearly  seen,  again,  by  phasors.   Let 

a  =   the  phase  of  X  (t)  which  will  be  one  of  the  four  values  shown 

K 


in    figure    '. 
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Figure  8.   Demodulation  Considerations. 
This  indicates  that  the  detection  scheme  considered  above  is  actually 
a  matter  of  determining  polarity  after  the  incoming  signal  has  been 
demodulated.   Therefore,  the  converter  in  figure  7  has  only  to  determine 
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the  polarity  of  X-  (t)  and  X0  (t)  in  order  to  be  able  to  generate  A 
and  B.   Before  ending  the  phase  modulation  section,  it  should  be  noted 
that  the  detection  scheme  has  been  a  fixed  reference  one  as  opposed  to 
a  differential  detection  scheme.   This  requires  that  phase  and  frequency 
of  the  carrier  be  available  at  the  receiver.   The  MODEM  scheme  used  is 
a  DSB/SC  one  so  these  quantities  must  be  obtained  by  either  transmitting 
a  carrier  or  generating  the  carrier  (with  phase  shift,  0)  at  the  receiver. 
One  possible  method  of  generating  a  phase-locked  carrier  is  described  in 
reference  L  2  J.   In  this  article,  J.  P.  Costas  proposes  a  synchronous 
detection  scheme  which  combines  the  in-phase  (I)  and  quadrature  (Q) 
components  in  a  phase  discriminator.   The  components  are  combined  in  a 
manner  which,  along  with  frequency  control  circuitry,  enables  a  local 
oscillator  to  obtain  and  maintain  phase-  and  frequency-  lock. 
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4.    Amplitude  Modulation  -  Demodulation  Systems. 

The  subject,  amplitude  modulation,  being  the  oldest  and  most  common 
modulation  method,  is  covered  quite  thoroughly  in  textbooks  and  in  the 
literature.   With  that  thought  in  mind,  I  have  decided  to  omit  an  extend- 
ed study  of  AM  and  to  include  only  some  systems  which  will  be  suitable 
to  be  used  in  this  overall  system. 

As  a  starting  point,  the  necessary  properties  of  the  AM  system 
should  be  described.   The  information  to  be  transmitted  is  to  be  ob- 
tained from  the  amplitude  of  the  carrier.   In  digital  communications, 
this  amplitude,  ideally,  will  be  one  of  two  possible  values  depending 
on  whether  a  0  or  a  1  was  transmitted.   In  the  non-ideal  case,  the  two 
values  of  the  amplitude  are  the  expected  values  (means)  of  two  random 
variables.   Unless  otherwise  stated,  these  expected  values  will  be  used 
below. 

Let  these  two  possible  amplitudes  be   S  and   kS  where  k  is  non- 
negative  and  less  than  one  \0  ^k<lj . 
TT   ff  J  f  "T  ~  1   , 

II   II  i        '  1  A  1 

carrier 


l4v»cU   t<2A\Jc\cp<z) 


I  r,.  : 


Figure  9.   Basic  AM  Signal. 
Note  that,  if  k=0 ,  we  have  an  elementary  AM  system  in  which  one  state 
of  the  system  is  represented  by  the  presence  of  a  carrier  and  the  other 
state  by  the  absence  of  the  carrier.   One  final  thought,  before  consid- 
ering specific  examples  of  AM  schemes,  should  be  stated.   In  many  AM 
methods,  the  phase  of  the  carrier  is  changed  when  the  carrier  is  ampli- 
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tude  modulated.   However,  that  is  the  basis  of  the  FM  system  studied 
above.   Therefore,  a  basic  property  of  these  AM  systems  must  be?  the 
requirement  that  the  phase  of  the  carrier  be  unaffected  by  the  AM  system, 

Consider,  first,  a  variable-gain  amplifier  to  accomplish  amplitude 
modulation.   The  carrier  is  the  input  to  the  amplifier;  i.e.,  it  is 
applied  to  the  control  grid  of  a  triode,  tetrode,  or  a  pentode.   The 
modulating  (information)  signal  is  added  to  the  DC  plate  or  screen 


supply  voltage. 
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Figure  10.   Variable-Gain  Amplifier. 

Another  system,  currently  being  used,  is  the  "Al  Data  System" 
L 6 J.  developed  by  the  Bell  System  for  the  SAGE  (Semi-automatic  Ground 
Environment)  system  for  continental  air  defense.   In  this  system,  the 
carrier  is  modulated  by  a  ternary  signal  having  relative  levels  of  1.00, 
0.73,  and  0.27.   The  maximum  level  is  used  as  a  framing  signal,  while 
the  two  lower  levels  carry  the  binary  information.   A  further  descrip- 
tion and  discussion  of  this  system  can  be  found  in  the  reference  cited 
above. 

In  any  case,  envelope  detection  will  be  used  in  conjunction  with  a 
threshold  device  to  distinguish  between  the  two  levels.   This  detector 
could  be  about  anything  from  a  full-wave  rectifier  to  a  much  more  elabo- 
rate system. 

As  noted  above,  this  section  of  the  paper  is  not  concerned  with 
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specific  systems  or  schemes  because  such  a  discussion  would  add  little, 
if  anything,  to  the  picture. 

Let  it  be  stated,  simply,  that  the  AM  system  will  give  us  a  two- 
level  signal  with  negligible  modification  of  the  carrier  phase. 
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5.    The  Combined  AM-PM  System. 

In  the  preceding  paragraphs,  AM  and  PM  systems  have  been  discussed 
in  some  detail.   Consider,  now,  the  next  stage  in  the  development  of  the 
system. 

According  to  N.  M.  Blackman  LlJ,  the  capacity  of  either  an  AM  or  a 
PM  system  can  approach  half  the  full-channel  capacity,  predicted  by 
Shannon,  for  a  high  signal  to  noise  ratio.   For  a  low  (less  than  unity) 
signal  to  noise  ratio,  the  capacity  of  a  PM  system  approaches  79%  of  the 
full-channel  capacity  while  the  AM  system  is  limited  to  about  17%. 
Blackman  further  states  that  the  full-channel  capacity  can  be  approached 
if  AM  and  PM  are  combined  in  the  same  system.   This  capacity  is  approach- 
ed, most  closely,  at  low  signal,  to  noise  ratio. 

It  will  be  the  purpose  of  this  paragraph  to  indicate  how  the  AM  and 
PM  schemes  can  be  combined  into  a  single  sub-system.   Finally,  several 
of  these  subsystems  will  be  frequency-division  multiplexed  into  a  single 
system. 

The  capacity  of  this  system  will  not  approach  the  capacity  theo- 
rized by  Shannon  but  it  will  combine  a  reasonably  high  capacity  with 
fairly-low  error  rates. 

With  this  introduction  in  mind,  let  us  consider  the  system. 
Let: 

ss  C*-o  ( u)c-£  -f  e)  c^o^oJ-^J 


F(WC^)  =  rf^c^iv^j   wlere   © 
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Figure  11.  Modulator  Section. 
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S-r  1 1  i  0  = 

ST  (no)  =i 
S-r  (><>/)  = 
St  tloo)  =r 

5r(o'  0  - 
S-r  (o/o)    = 

Sr  (°0/)  s 

Sr  (ooo)   = 

The   set,    S. 


>  ST  Oil) 
M.  Sr(iof) 

Jk  ST  (oil) 

^  ST  (oo/j 

represents  the  transmitted  signal  space  for  figure 


12.   (See  phasors  in  figure  5) 
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Figure   12. 
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Figure  13.   The  AM-H1  Demodulator  Section. 
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With  the  exception  of  the  envelope  detector  (or,  more  accurately, 
threshold  type  receiver) ,  the  components  used  in  figure  IS  have  been 
described  earlier  and  will  not  be  discussed  here. 

The  foregoing  has  been  one  way  to  combine  AM  and  FM;  i.e.,  phase- 
modulating  an  amplitude-modulated  carrier.   Another  way  could  be  the 
scheme  indicated  below. 
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Figure  14.   An  alternate  AM-FM  System. 
The  system  shown  in  figure  14  is  a  bit  more  error-free  than  the  original 
system  because  the  carrier  is  transmitted.   The  system  has  a  significant 
drawback,  however,  in  that  there  is  a  good  chance  of  sidebands  over- 
lapping. 

Using  the  original  system  (figure  11  &  13),  the  "  efficiency  "  of 
the  system  can  be  increased  by  frequency-division  multiplexing  several 
subsystems  of  the  type  shown  in  figures  11  and  13. 

A  coding  (error  detection  and  correction  or  EDAC)  scheme  will  be 
discussed  below  to  permit  minimum  error  rate  for  the  capacity  of  this 
system.   A  block  diagram  of  the  entire  system  is  given  below. 
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6.    Error  Probability  Considerations  -  The  AM  System. 
Define  the  following: 


'X 


=   Probability  density  function  of  X 


Random 
Variables 


P  (x)   =   Probability  that  P  X  or 

A 

fraction  of  the  time  that  X  <*  x 
S      =   Instantaneous  Carrier  Amplitude 
N      =   Instantaneous  Noise  Amplitude 
S      =  Long-Term  RMS  Carrier  Envelope 
N      =  Long-Term  RMS  Noise  Envelope 

so2 

R      =  — —     =     Average  (Power)  Signal-to-Noise  Ratio 


} 


erf(  — —  )   =  error  function  or  probability  integral 


yir 


J  e*f>lrKx)<l*t* 


Px,  y   =   P(X  >Y) 


Consider    first,    the   Gaussian  distribution. 


P(|X|>*)&    Px^*)-AT-eA    A    +      fire*      B 

e  r-f   (-  x)  =     er-f  C>S)    J     /,e>     e\>e/>   fo^^-f-tcA    a-f-  X 
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For  the  case  of  Gaussian  noise,  the  noise  envelope,  as  well  as  the 
envelope  of  the  carrier  subject  to  fading,  has  the  Rayleigh  distribution, 
Therefore,  consider  the  Rayleigh  distribution. 

$00*    ex^(-^/a«x4)  I.**    >0 

/Oct,   ".    J9J1    =     So      or     VoA 

At  this  point,  several  equations  may  be  written. 
Carrier  subject  to  Rayleigh  fading: 
/^  £■   -  exp(-t  /s^V  -   fraction  of  the  time  that  the  carrier 

amplitude  exceeds  a  level,  E. 
Noise  envelope  amplitude: 
*Vi£  '  6X^(~£y//^  =  fraction  of  the  time  that  the  noise 

envelope  amplitude  exceeds  a  level,  E. 
The  noise  can  be  resolved  into  two  components,  N  and  N0,  L4J ,  where 
N_  is  colinear  (either  in  phase  or  180  out  of  phase)  and  N  is  in 
quadrature  with  the  reference.  When  this  is  done,  the  fluctuations  of 
each  component  have  the  Gaussian  distribution  and  are  given  by: 
%£>€"%*,£  =   /-erffcM)  vhere 

aj  =  ajx^^^     *„d     Pu^>'g    or  p»Q>e     is  the 

fraction  of  the  time  that  the  component  is  greater  than  a  level,  E. 
Consider,  now,  envelope  detection  of  AM  signals. 

Let  a  binary  j  'I  r>  Carrier  Amplitude  =  *f  j^s  [ 

where    O  *  Jz.  <  \ 
Assume  that  1  and  0  are  equally  likely. 
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<      A    -      IrJ 


J. 

A 


(AS)' 


=  V^„3  =°/>s 


y      J. 
T   =    Hres/70/^      /eve./      -      <a>  S© 
uAere  ;  O  ■<    &*    <    I 

Before  continuing,  consider  the  signal  space  which  will  be  used  in 
the  following  calculations. 

1  Region  From  figure  16(a),  it  can  be 

seen  that  the  signal  space  is 
divided  into  two  regions,  the 
boundary  being  a  circle  with 
radius  T,  the  threshold  level. 
Vectors  kS  and  S  are  signal 
vectors  representing  0  and  1 
respectively;  N  is  the  noise 
vector 

Figure  16(a).   The  AM  Detection  Signal  Space. 

To  decide  whether  a  signal  represents  a  0  or  a  1,  the  noise  vector  is 
added  (vectorially)  to  the  signal  vector.   If  the  resultant  vector  lies 
anywhere  within  the  circle,  a'O1  decision  is  made;  if  the  resultant 
vector  lies  outside  the  circle,  a'l1  decision  is  made.   Some  examples  of 
the  system  decision  philosophy  are  given  below. 
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(b)  (c)  (d)  (e) 

0  transmitted   0  transmitted   1  transmitted   1  transmitted 

1  decision      0  decision      1  decision      0  decision 


error 


no  error 


no  error 


error 


Figure  16  (b-e).   The  M   Detection  Signal  Space. 

Case  1.   No  Carrier  Fading. 

Assume  the  signal  is  kS;  i.e.,  A  "0" 

was  transmitted. 

B 

Phaser  N  represents  the  Noise 

received,  kS  the  Signal.   The 

circle,  radius  T=aS  ,  represents 

the  threshold  for  an  envelope 

detector  '(i.e. ,  no  phase  discrimir; 

nation).   ABCD  is  an  approximation 

to  the  circle  to  simplify  the 

calculations. 

Figure  16(f).   AM  Detection  Signal  Space. 

There  will  be  no  error  if  the  resultant  vector,  kS  +  N,  lies  inside  the 

square,  ABCD  (ideally  the  circle  should  be  used  but  ABCD  will  be  quite 

accurate).   This  requires: 

(1)  /(AS  +»x)l  <T       or-       tir<T-J<.S        i*      A)x 

(3)    |AJq|  <  T 


/             I 

'                  aJ<j 

1         f             \ 

/      As 

\      r  aJi  us  —  T" 

i 

-   a>  So              / 
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It    can  be   assumed    that   N     and   kS  will   be    in   phase  half   the    time   and    180 
out   of   phase   half   the    time. 

p[/)o  e.rrcr   uU,    0   tr,,,.'*^.   PlJu  +  A  ,.,    „,,„|«    A8CC2 

0    tr^SM.TTcr)  c**r|,-f,0*    (3) 


/Jo 


=.    1  -   P0  (^o  e,vr-or) 


^ssov^e    ^<=    ^5»J    '5    5  ;   ,,*,    A   1     ^*s    -hr/>»s  »n  f/-crl  t 


/                i 

\         A         \ 

/                      ^Q 

7            \ 

r- 

T-fc 

\ 

r 

1^ 

s 

v  y 

|s+rj 

Figure  16(g).   AM  Detection  Signal  Space, 
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There  is  an  error  if  S+N  is  inside  ABCD.   If  N  is  in  phase  with  S, 

it  introduces  no  probability  of  error.   If  N  is  180  out  of  phase,  there 

is  an  error  if  (S-T)<  N  <  (S+T) 

Therefore,  for  a  detection  error: 

,o 


(1)  N  must  be  180  out  of  phase  with  S. 

(2)  (S-T)<  Nj  <  (S+T). 

(3)  I  NQ  |  <  T 

P.  (error)  =  Prob.  of  an  error  when  a  1  is  transmitted. 

P  (s«-i-»r)-  X  pa  («rror)  ■*- ^  P,  (.t-rror) 

-  ert[(c+£)fir]-e*4|k3r   *>f?   J  '    ' 

+  ••-*[(■£ +«jnr]  ]■ 

Case  2.   Carrier  subject  to  Rayleigh  fading. 

In  this  case,  the  I  &  Q  components  of  the  signal  are  Gaussian, 
those  of  the  noise  are  also  Gaussian  and,  therefore,  the  I  &  Q  components 
of  S+N  and  kS+N  are  Gaussian.   Therefore,  the  vectors,  S+N  and  kS+N,  are 
Rayleigh. 

When  a  0  is  transmitted,  the  signal  is  kS  and  there  is  an  error  if: 
(m-kS)   >  T  or  N  >  (T-kS)   . 
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If  a  1  is  transmitted,  the  signal  is  S  and  there  will  be  an  error 

if:  (S+AJ)  <    T 

P<    L&rrar)    =    PT ,  fj  +  s    -     |     -     ^tSjT 

=    |-   ft>p[-<fcaff/(|  +  R)] 

Aisuivnoq     /'a       *  »  <^     O's       c?u*>lly     likely    * 
p  terror)    =  -X  p0(crror)    *  ■£■    P,  (error) 


*  Define  a  as  the  value  of  the  threshold,  a,  giving  a  minimum  P(error). 


To  obtain  a 
6  P 

6  cj 


0u=Cb 


a,aK 


aa/? 


'tf.=S. 


*   It  should  be  noted,  at  this  point,  that  the  foregoing  probability 
equations  are  exact.   Approximating  the  circle  with  a  square  was  a 
mathematical  tool  which  has  served   its  purpose. 
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—  e. 


^[(^(t^  -ttf)] 


Substituting  this  into  the  equation  for  P(error) : 


R  (error)  s    )  - 


J 


Sua-***/ 

J . 


P6  Cerrdr)=    r_, 

RLcrrtr)   =T  -£  Q  P((error)  *  Pe  (cr-r-or)j 

-4 1  I  -    -   /'^Wf    *   '    pSXTT  ] 


■■*['-  ~7™ 


-/ 


■j  (>-[-' +E,:^^]A  e(i^)j/ 


i- 


/  i+<k*e  ) 


t\     p  (error)  =  j 


39 


Finally,  some  notes  concerning  a  can  be  made.   Referring  to  the 
appendix,  it  is  noted  that  a  is  nearer  to  S  than  to  kS  in  most  cases. 
This  is  because  the  "instantaneous  signal  to  noise  ratio"  is  higher  if 
the  signal  is  S  (as  opposed  to  kS) . 

The  threshold,  a,  is  set  at  levels  dependent  on  R;  the  manner  in 
which  this  is  done  is  seen,  most  clearly,  by  an  example. 

R-l       >.=  0.£*       <£  =  |,AfA   (see  ^(/k/<0 

se  =  y^f  "'  s     a   0,nq  s 

Therefore:     / ,  00  S  i  S  *  ^  2.10% 

where  S*, (kS)*  are  random  variables  with  means  S  and  kS  respectively. 


I  .a«  S 

,S0  b 


RftncjG   0-f  S 


fc««?e  0$  (ks)* 


Figure  17.   Amplitude  Relations. 
It  can  be  seen,  from  figure  l^s  that  the  threshold,  a,  is  set  at  the 
amplitude  which  will  separate  the  random  variables,  S*  and  (kS)*  the 
maximum  amount  of  the  time 

In  this  system,  an  optimum  k  ("0"  signal  level)  will  have  to  be 
selected  but  the  threshold,  as  will  be  assumed  to  be  adjusted  to  a,  as 
R  varies,  by  AGC-type  circuitry.   Therefore,  the  threshold  will  be  at  an 
optimum  level  for  the  values  of  k  and  R  present  at  the  receiver. 
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7.    Error  Probability  Consideration  PM. 

Earlier,  it  was  shown  (see  figure  5)  that  the  phasors  for  the  four- 
phase  system  are  as  shown  below: 


A  ttvA$ 


tifo 


-Mi 


Figure  18.   Four-Phase  System  Signal  and  Noise  Phasors. 
In  figure  18,  we  see  that  the  noise  vector,  N,  when  broken  into  colinear 
(N  )  and  quadrature  (Nn)  components  has  several  possible  combinations  of 
N  and  NQ: 


Signal  Vector 

Noise  Vectors 

(CS) 

which  could 

affect  CS 

11 

-Nr  -NQ 

01 

+NI>  "  NQ 

00 

+Nr  +NQ 

10 

-Nr  +NQ 

Figure  19.   Noise  and  Signal  Vectors. 
It  should  be  stated  that  only  one  of  the  noise  components  given  in  the 
right-hand  column  of  figure  19  need  be  present  to  cause  a  detection  error 
For  instance,  if  the  signal  vector,  CS,  is  11,  a  noise  vector  containing 
any  of  the  following  components  would  cause  an  error:   -N  ,  -N  ,  -N  and 
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An  example  is  shown  below: 


Figure  20.   Examples  of  effect  of  noise  on  Signal  11. 

Since  this  is  a  gray  code,  the  noise  phasors  described  above  will 
cause  the  S  +  N  phasor  to  be  in  an  adjacent  quadrant  and  only  one  of  the 
two  bits  will  be  in  error.   In  figure  20,  it  can  be  noted  that  one  of 
the  two  bits  will  be  incorrectly  detected  if  the  noise  components  have 
the  sense  indicated  in  the  table  and  the  magnitude  of  either  N  or  N_  is 
greater  than  CS  cos  45  . 


Let  N_,  be  either  L  or  N  . 
C  I      Q 

Case  1.   No  Carrier  Fading. 


P(er-ror)-       [proL<tae"tb    ^X     ^  R-*b  •  d  o  e  ~fo     A^djJ 
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/rob.     ai     &v<ror-      Jos.     To       ^c 


'  -ir  L'  "  *^("^r^J 


-up  -  j_ 


Case  2.   Carrier  Subject  to  Rayleigh  Fading 
Assume  "1"  transmitted, 
The  relative  probability  of  carrier  level,  S,  is  pS  given  by: 

Given  a  level,  S,  the  IM  error  (from  preceding  page)  is: 
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P>    (£rr0r)  =  fi(PCerror)) 


s  -=© 


.CO 

Ce3«S/<-r<rf"    P"   ,' 


fc  &0 


F=    (erJ(^s)[eV(-S*/5.»)]ifL  <*S 


To  obtain  du,  go  back  to  the  density  function  and  distribution  function 
of  the  Gaussian  distribution. 


X  >  o 
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rV»^     iLe      G  re-ced /nq      <£  4  v  a  iien  3    -for     P^X)  I 


£,  r- 


■f  b%)  =^>x^  -^p^-xV^OJ* 


«2     >t/ 


/tcrfX7-%f     *r     &r*=a/Jc* 


.  y 


JjM   (f>rrte,\,nf    {>*??)-    <£[c,t--f    (    ~pj     5)  J 


-     _^ 


5^0 


YF 


[evp(-sV^^A)J    ^S 


-yx" 
p  ST  jj-^ —  f 


-v- 


Juxj 


o 


-L*rl(Trcs%faM-5Vs**f] 


+  £r    -t 


5  =  0 


Cm» 


If 


U~  ;  £=-/vJa-^/«P[-sV(tr^)]jl5 


R  = 


"HP 

J-   4--L-    -       A+  & 


M 


PS/ 
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£  =  — ^4=: 

'  '         Voir 


j^/°[-{(^)/«2^}52]  £S 


fro™      **y     Joed     f/)£/«      of    d&f/»?7e       \frhzprAiJ     ' 


oe 


JUL 

3&* 


d~   ">  o 


*    / 


^    = 


-i 


n 


£+3. 


This,  recall,  is  the  PM  prob.  of  error,  with  a  fading  carrier,  when  a 
1  is  transmitted. Similarly: 

Finally,  the  probability  of  error  in  PM  with  carrier  fading  and  an  equal 
liklihood  of  transmitted  l's  or  O's  is: 

P(error)  =  \   [p. (error)  +  P  (error)J 

[o-varM'-igei] 


4 


-4[»r 


k*fL+-a- 


1 
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8.    Error  Probability  Considerations  The  AM-PM  System. 

In  this  section,  the  pretense  of  no  carrier  fading  will  be  dropped; 
henceforth,  carrier  fading  with  a  Rayleigh  distribution  will  be  assumed 
as  well  as  Gaussian  noise. 

Consider  a  transmission  group  of  3  bits,  ABC,  where  A  is  transmitted 

by  means  of  an  AM  scheme  and  B,  C,  a  PM  scheme.   These  modulation  methods 

are  those  described  above.   In  this  group  there  are  possibilities  of  1, 

2,  or  3  bits  being  in  error. 

Let:   P^   s  Prob(AM  bit  is  in  error) 
AM 

pfiM  =  -f  l  i n5EO 

(fa        jifli       been      S  u  los  77  i*J  7"e  a 
p^=      P   (-<-     ti"fe      ore      »«     €i-r«<-     »«  «    <j<~cvp)  jx  ^)tJ,3 

P,   S    p*M   -f-  Pp/1 

p^  r  R,^  PPA1  +  Pp*  Ppaa 

Pa  *  '  /^m  rp^i  /  pai 

In  the  computer  program  (Appendix)  these  are  denoted: 

pPM  =  PE4B-P* 
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It  would  seem  to  be  advisable,  at  this  point,  to  discuss  the  compu- 
tations included  as  an  appendix.   All  of  the  formulas  used  have  been 
derived  and  discussed  in  preceeding  sections.   These  formulas,  with  the 
computer  program  notation,  are  as  follows. 


A«T)     =•    Jk   = 


^  «  '/ 


QV13 


J)       -      £     =      TlreiLelrl        L  e «/ « / 


/ 


Pfc<fcB  (X)    a     P*^ 


"    4 


r  -   .or   -yfi^KZ1  i 


P£<J>SS(;T) 
PROBST) 


P(2  c&R) 


p,  i     Prf*  +   Pp* 

Pa     =     P*„  Pp/M    P/O/M 


P 


At  this  point,  the  question  of  choosing  k,  the  "0"  signal  level^ 
should  be  considered.  Recall,  k  is  the  minimum  instantaneous  carrier 
amplitude  as  indicated  in  figure  9.  which  is  reproduced  below. 
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v  O  "  S  ,C  y\«I         Level 


Figure  9  (reproduced).   Basic  AM  Signal. 
Two  points  are  obvious  at  this  point.   For  the  lowest  probability  of 
error  in  AM,  kS  should  be  near  zero  while  for  PM,  kS  should  be  near  S. 
A  perusal  of  the  computer  printout  of  PROB-AM,  PROB-FM,  P(2  ERR)  or 
P(3  ERR)  confirms  this  statement.   However,  a  study  of  P(l  ERR)  gives 
a  hint  to  answering  the  question  of  the  value  for  k.   Consider  the  table., 
belowjof  the  value  of  k  minimizing  P(l  ERR)  as  a  function  of  R,  the  sig- 
nal to  noise  ratio. 


R(db) 

k   (for 

-10 

0.9 

0 

0.5 

3 

0.4 

7 

0.3 

10 

0.3 

20 

0.2 

30 

0.1 

40 

0.1 

Figure  21.   Table  of  k  for  minimum  P(l  ERR) 

The  best  way  to  set  the  value  of  k  would  be  to  let  it  be  easily 
changed  so  that  it  could  be  set  at  an  optimum  for  the  expected  value  of 
R.   This  value  of  R,  of  course,  would  depend  on  such  factors  as  trans- 
mission path  length  and  atmospheric  conditions.   If  one  value  had  to  be 
selected,  I  would  set  k  at  about  0.4  because  this  would  give  a  minimum 
average  (mean)  P(l  ERR)  for  the  range  of  R  used  above. 
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A  last  remark  concerning  error  probabilities  deals  with  the  effect 
of  multiplexing  several  of  these  subsystems  into  one  system  as  discussed 
earlier.   At  first  thought,  it  would  seem  that  putting  five  subsystems 
into  a  single  system  would  increase  the  probability  of  a  given  number  of 
bits  being  in  error.   This,  however,  is  not  the  case.   Although  the 
number  of  ways  of  having  this  given  error  increase,  the  number  of  ways 
of  not  having  it  increase  by  the  same  proportion  so  that  the  probability 
of  this  error  remains  the  same. 

Perhaps  a  clearer  way  to  see  this  is  to  recall  the  probability  and 
statistics  q/TUmick  of  the  urn  with  colored  balls  in  it.   If  this  urn  con- 
tains one  red  ball  and  one  black  ball,  the  probability  of  drawing  a  red 
ball  is  one-half.   If  the  urn  contains  100  balls  of  each  color,  the 
probability  of  drawing  a  red  ball  is  still  one-half. 

This  concludes  the  transmission  problem  of  getting  information  from 
one  place  to  another.   In  the  following  paragraphs,  the  concept  of  cy- 
clic coding  will  be  introduced.   Finally,  the  use  of  error  detection  and 
correction  codes  for  this  system  will  be  discussed. 
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9.   The  Concept  of  Cyclic  Codes. 

"The  concept  of  cyclic,  or  polynomial,  codes  is  considered  one  of 

the  major  breakthroughs  in  coding  theory."  15-J  A  cyclic  code  is  defined, 

most  clearly,  by  the  property  that  makes  it  different  from  other  codes: 

Any  cyclic  permutation  of  a  cyclic  code  word  results  in  another  cyclic 

code  word. 

Examples  — 

If  a, ,  a.  .  .  .  a„  -a„   is  a  code  word,  then  a.Ta.  . .  .aca,a.7  .  . 

1   2        N-l  N  N  1    5  6  N-l  is  a 

code  word. 
The  importance  of  cyclic  codes  stems,  mainly,  from  the  fact  that  they 
are  easily  implemented  with  shift  registers.   In  the  remainder  of  this 
section,  we  shall  see  how  binary  information  can  be  represented  by  poly- 
nomials in  a  dummy  variable.   Following  that,  the  principles  of  error 
detection  and  correction  with  cyclic  codes  will  be  discussed.   Finally, 
the  implementation  of  cyclic  codes  will  be  considered.   Polynomial  Repre- 
sentation of  Binary  Information  --  Consider  a  message  coded  into  k  bits 
with  (n-k)  bits  added  as  a  check.   Think  of  the  bits  as  a  polynomial  in 
X,  a  dummy  variable. 

Example  --   110101     1  +  X  +  X3  +  X5 
These  polynomials  will  be  treated  according  to  the  rules  of  ordinary 
algebra  except  addition  is  done  modulo  2.   It  should  be  noted  that  addic- 
tion and  subtraction  are  the  same  in  modulo  2  arithmetic. 
Therefore:       lXa  +  lXa  =  0Xa 

oxa  +  oxa  =  oxa 

oxa  +  ixa  =  ixa 

-ixa  -  ixa 
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The  message  -- 


information 
—  k  bits  — J 


check 


(n-k)  bits  — fe 
n  bits  n. 


message 
Definitions  -- 

P(X),  degree  (n-k),  is  the  Generator  Polynomial  and  is  not  diviei&le 

by  x. 
A  polynomial  of  degree  less  than  n  is  a  Code  Polynomial  (i.e.  ac- 
ceptable for  transmission)  if,  and  only  if,  it  is  divisible 
by  P(X). 
Therefore,  code  polynomials  could  be  formed  by  multiplying  any  polynomi- 
al of  degree  less  than  k  by  P(X).   Consider,  however,  the  following  meth- 
od which  gives  a  code  polynomial  which  has  the  properties  that: 
Higher-order  coefficients  are  message  symbols,  and 
Lower-order  coefficients  are  check  symbols. 
The  method  of  forming  code  polynomials  is  that  presented  by  Peterson  and 
Brown  in  references  15-1.   The  reader  should  bear  in  mind,  however,  that 
this  is  not  the  only  method  available  to  form  code  polynomials. 
To  encode  a  message  polynomial,  G(X),  divide  X*         G(X)  by  P(X)>then  add 
the  remainder,  R(X) ,  resulting  from  the  division,  to  X     G(X)  to  form 
the  code  polynomial,  F(X). 

p-quotient    —-remainder 

(n-k)       ^  ▼ 

X^n  k;g(x)  =  q(x)p(x)    +  R(x) 

(recall,  in  mod  2  arithematic,  addition  h  subtraction) 

F(X)  =  X(n_k)G(X)  +  R(X)  =  Q(X)P(X) 

Since  Q(X)P(X)  is  a  multiple  of  P(X),  it  is  a  code  polynomial;  therefore, 
x(n-k)G(x)  +  R(x)  =  F(x)  ig  a   cQde  polynomial; 
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F(X)  =  X(n_k)G(X)  +  R(X) 


L 


t 

*— degree  less  than  (n-k)  . 
zero  coefficients  in  the  (n-k) 
low-order  terms. 


Therefore:   (1)  The  k  highest-order  coefficients  of  F(X)  are  the  same 
as  those  of  G(X)  which  are  the  message  symbols.   (2)  The  (n-k)  low- 
order  coefficients  of  F(X)  are  the  coefficients  of  R(X)  and  these  are 
the  check  symbols. 

In  an  effort  to  understand  what  has  been  done,  let  us  consider  an 
example  on  the  next  page. 
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\     PCX)    =     j*x+  x4 
/  ,     GU)  =.   /4-y«  +  X  ^  X¥  *X  " 


r|t> 


+      X 


**>-/- X-5"       +■    X3      + 


+-x"fx'° 


+  X' 


*X' 


+x 


f 


•H(?  ^x* 


1 


10 


^7^fc 


,6 


+Xfe  +XA 


r 


4Xr+X4 


X 


+**  -»-x 


RM  = 


-      XJ  4-X*  +x 


Tnere-forc    '. 

F(x)  =  RU)  +  x^^Cx) 

~     O  M  I   I o oo / o  o  /  /  o / 


S  y w  to/5 
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General  Principles  (EDAC)  -  - 

An  encoded  message  (at  the  receiver)  can  be  represented  by: 


H(X)  =  F(X)  +  E(X) 

correct  \  polynomial  having  a  non- 
message    zero  term  in  each  erroneous 
position. 


£ 


Because  the  addition  is  mod  2,  F(X)  +  E(X)  is  the  true  message  with 

erroneous  positions  changed. 

Two  observations  may  be  made  at  this  point: 

(1)  If  H(X)  is  not  divisible  (evenly)  by  P(X),  then  an  error  has 
occurred. 

(2)  If  H(X)  is  divisible  (evenly)  by  P(X),  an  error  may  or  may  not 
have  occurred. 

Therefore,  to  insure  an  effective  check,  P(X),  must  be  chosen  so  that  no 
error  pattern,  E(X),  which  we  wish  to  detect  is  divisible  by  P(X). 
The  ability  of  a  code  to  correct  errors  is  related  to  its  ability  to 
detect  errors.   For  example,  any  code  capable  of  detecting  all  double 
errors  can  correct  single  errors.   This  can  be  seen  by  noting  that  if  a 
single  error  occurs,  we  can  try  to  correct  it  by  trying  to  change  each 
message  symbol.   A  polynomial  with  one  error  and  one  symbol  changed  can 
be  a  code  polynomial  only  if  the  erroneous  symbol  is  the  one  which  was 
changed.   All  other  combinations  are  equivalent  to  double  errors  and, 
therefore,  are  detectable.   Similarly,  a  code  which  detects  all  combi- 
nations of  2t  errors  can  correct  any  combination  of  t  errors;  if  t  or 
fewer  errors  occur,  changing  all  combinations  of  t  or  fewer  positions 
results  in  a  code  polynomial  only  if  all  the  erroneous  positions  are 
changed.   The  same  argument  shows  that  any  code  capable  of  detecting 
two  error  bursts  of  length  b  or  less  can  correct  any  single  burst  of 
length  b  or  less.   Finally,  the  converse  of  the  above  is  true;  a  code 
capable  of  correcting  t  errors  can  detect  2t  errors,  for  example. 
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Detection  Theorems.  -  - 

The  proofs  of  these  theorems  are  given  in  reference  L5J  . 

Detection  of  Single  Errors 

Theorem  1. 

A  cyclic  code  generated  by  any  polynomial,  P(X),  with  more  than  one 

term  ("at  least  1+x")  detects  all  single  errors. 

Theorem  2. 

Every  polynomial  divisible  by  (1+x)  has  an  even  number  of  terms. 

Lemma  (a)  Any  code  generated  by  P(X)  =  (1+x)  detects  any  odd  number 

of  errors.  .     „ 

Lemma  (b)  Since  (1  +  xc)  =  (1  +  x)  (x°~  +  x°'  "  +  ...+1),  any 

P(X)  containing  a  factor,  (1  +  xc),  will  detect  an  odd 
number  of  errors. 

Double  &  Triple  Error  Detection 

A  polynomial,  P(X),  is  said  to  belong  to  an  exponent,  e,  if  e  is  the  . 

least  positive  integer  such  that  P(X)  evenly  divides  (xe  -  1)  which  is 

the  same  as  (x  +  1)  in  mod  2. 

Theorem  3. 

A  code  generated  by  P(X)  detects  all  single  and  double  errors  if  the 

length,  n,  of  the  code  is  no  greater  than  the  exponent,  e,  to  which  P(X) 

belongs. 

Note:   It  can  be  shown  that  for  any  m,  there  exists  at  least  one 
P(X)  of  degree  m  that  belongs  to  e=2m-l.   This  is  the  maximum 
possible  value  of  e.   Polynomials  with  this  property  (called  prim- 
itive polynomials)  are  always  irreducible.   Thus,  for  any  m,  there 
is  a  double  error  detecting  code  of  length  n=2m  -1  generated  by 
a  P(X)  of  degree  m.   This  code  has  m  check  symbols  and  2m  -1-m 
information  symbols.   These  codes  are  completely  equivalent  to 
Hamming  single-error  correcting  codes. 

Theorem  4. 

A  code  generated  by  P(X)  =  (1  +  x)P,  (X)  detects  all  single,  double  and 
triple  errors  if  the  length,  n,  of  the  code  is  no  greater  than  the  ex- 
ponent, e,  to  which  P   (X)  belongs. 

Detection  of  a  Burst-Error 
A  burst-error  of  length  b  is  defined  as  any  pattern  of  errors  for  which 
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the  number  of  symbols  between  the  first  and  last  errors,  including  these 
errors  is  b. 

Example  -- 

3    fi    7 
E(X)  =  x  +  x  +  x 

or 

000100110000000 

b  =  5 

Theorem  5. 

Any  cyclic  code  generated  by  a  polynomial  of  degree  (n-k)  detects  any 

burst-error  of  length  (n-k)  or  less.   A  high  percentage  of  longer  bursts 

are  detected,  as  well. 

Theorem  6. 

The  fraction  of  bursts  of  length  b  >(n-k)  that  aires  NOT  detected  is: 

2-(n-k)  if  b  >(n_k^.1)      2"(n"k)  if  b  =  (n-k+1) 
Detection  of  Two  Bursts  of  Errors 

Theorem  7. 

The  cyclic  code  generated  by  P(X)  =  (1  +  x)P.  (X)  detects  any  combination 

of  two  Iburst  errors  of  length  two  or  less  if  the  length,  n,  of  the  code 

is  no  greater  than  e,  the  exponent  to  which  P  (X)  belongs. 

Note:   These  codes  are  not  unlike  Abramson  and  Fire  codes. 

Theorem  8. 

The  cyclic  code  generated  by  P(X)  =  (x  +  1)P..(X)  will  detect  any 

combination  of  two  bursts, 

e(x)  =  x3^  (x)  +  xh2   (X) 

provided:   1)  (C  +  l)^the  sum  of  the  lengths  of  the  bursts. 

2)  P.  (X)  is  irreducible  and  of  degree  at  least  as  great  as 

the  length  of  the  shorter  burst. 

3)  The  length  of  the  code  is  no  greater  than  the  least 
common  multiple  of  C  and  the  exponent,  e,  to  which  P.. 
(X)  belongs. 

The  use  of  these  theorems  is  summarized  by  the  table  on  the  next  page 

taken  from  reference  L5 J . 
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k  = 


n  = 


Notation 
number  of  binary  digits  in  the  message  before  encoding. 

number  of  binary  digits  in  the  encoded  message. 

number  of  check  digits. 

length  of  a  burst  of  errors. 

message  polynomial  (of  degree  k-1). 


n-k 

b 

G(X) 

P(X)  ■  generator  polynomial  (of  degree  n-k). 
R(X) 


,n-k. 


remainder  on  dividing  X   G(X)  by  P(X). 
R(X)  is  of  degree  less  than  n-k. 

F(X)  =  encoded  message  polynomial.  F(X)  =  Xn~kG(X) -R(X) . 

E(X)  =  error  polynomial. 

H(X)  =  received  encoded  message  polynomial. 
H(X)  =  F(X)  +  E(X). 


A  Short 

Table  of  Primitive 

Polynomials 

Primitive  Polynomial 

e 

1  +  X 

x2 

1 

1  +  X  + 

3 

1  +  X  + 

X3 

7 

1  +  X  + 

X4 

15 

1  +  X*  + 

x5' 

31 

1  +  X  + 

X6 

63 

1  +  X3  + 

x7 

127 

1  +  X^+ 

x3+  x*+ 

X1 

255 

1  +  X*+ 

X9 

511 

1  +  x3+ 

x'° 

1023 

1  +  x^+ 

x" 

2047 

1  +  X  + 

x4+:  x6+ 

x>x 

4095 

1  +  X  + 

x3+  x*+ 

x'3 

8191 

1  +  X  + 

x6+  x'  + 

x" 

16383 

1  +  x'4+ 

X* 

32767 

Figure  22.   Notation  and  Primitive  Polynomials.  L5J 
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Implementation 

Consider  the  example  used  earlier  -- 

n  =  15     k  =  11 

P(X)  =  x4  +  x  +  1  =  10011 

xn"kG(X)  =  xM  +  x  ,a  +  x"  +  x?+  x*  =  101100100010000 


10101101010   =  Q(x) 

10011   /   101100100010000 

10011 

01010100010000 
00000 


1010100010000 

10011 

011000010000 

00000 

11000010000 

10011 

1011010000 
10011 
010110000 
00000 
10110000 
10011 
0101000 
00000 


101000 
10011 
OHIO 
00000 


1110  i>  x3  +  kX  +  x  =  R(X) 

This  example  shows  that  mod  2  division  is  a  repetitive  process. 
Recalling  that  only  the  remainder ,R(X) ,  is  actually  needed,  the  steps 
can  be  listed. 

(1)  Align  the  coefficient  of  the  highest  degree  term  of  the  divisor 
and  the  highest  degree  term  of  the  dividend  and  subtract  (or  add). 

(2)  Align  the  coefficient  of  the  highest  degree  term  of  the  divisor 

and  the  coefficient  of  the  highest  degree  term  of  the  difference  and 
subtract. 

(3)  Repeat  the  process  until  the  difference  has  a  lower  degree  than  the 
divisor.   The  final  difference  is  R(X) . 
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With  the  rules  outlined  on  the  preceding  page,  we  can  synthesize  a 
simple  feedback  register  to  perform  this  division.   This,  I  believe, 
shows  that  a  cyclic  code  is  easily  implemented  as  stated  earlier. 

(See  the  diagram  on  the  next  page) 

Initially,  all  delays  are  in  the  '0'  state  so  that  the  pulse  on  the 

feedback  path  is  '0'  for  the  first  (n-k)  clock  pulses.   Starting  with 

clock  pulse  (n-k+1),  the  feedback  pulse  may  be  either  a  '0'  or  a  '1' 

depending  on  the  state  of  the  last  delay. 

Note;   The  first  (n-k)  clock  pulses  are  not  shown  on  the  diagram. 
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Figure  24.   A  Register  for  Modulo  2  Division. 
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Figure  25.   The  Cyclic  Encoder. 
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Gate  G,  is  open  (no  path)  until  (n+1)   '  clock  pulse. 
Gate  G„  is  open  (no  path)  after  n  clock  pulses. 
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10.   Cyclic  Codes  applied  to  the  AM-PM  System. 

In  the  preceding  paragraph,  it  was  shown  that  the  generator  poly- 

4 
nomial,  P(X)  =  1  +  X  +  X  ,  will  correct  all  single  errors.   A  glance 

at  the  data  in  the  appendix  shows  that  this  reduces  the  error  rate  of 
the  system  considerably.   In  addition  to  the  error  correction  capa- 
bility, the  P(X)  used  above  also  enables  the  system  to  detect  over  90% 
of  the  other  errors  as  shown  in  the  table  in  the  preceding  paragraph. 
A  simple  calculation  shows  that  for  a  signal  to  noise  ratio  at  the 
receiver  of  a  few  decibels,  the  rate  of  undetected  errors  is  of  the 
order  of  one  or  two  in  ten  thousand  bits.   If  this  would  be  unacceptable, 
the  system  capacity  could  be  traded  for  lower  error  rates  by  means  of 
duplicate  transmissions,  frequency  diversity  or  more  ingenious  coding 
schemes. 

One  final  remark  is  that  quite  realistic  conditions  have  been 
considered  in  that  both  carrier  fading  and  Gaussian  noise  have  been 
included. 
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11.   Conclusions. 

The  conclusions  to  be  drawn  from  this  thesis  are  simple  and  straight- 
forward. 

The  system  proposed  is  not  strictly  an  analytic  model  of  academic 
interest  alone.   It  could  be,  with  some  modifications  perhaps,  a  useful 
communications  system.   The  extent  of  the  modifications  would  be  deter- 
mined by  application  of  the  recommendations  for  further  study  proposed  in 
the  following  paragraph. 

The  other  conclusion  is  that  simplicity  of  implementation  and  usage 
of  cyclic  codes  is  evident.   This  family  of  codes  is  quite  new  but  can 
be  shown  to  contain  many  of  the  older  codes  such  as  Hamming,  Abramson 
and  Fire  codes.   This  simplicity  will,  without  doubt,  lead  to  further 
study  and  employment  of  cyclic  codes.   As  far  as  the  author  could  deter- 
mine, this  will  be  the  first  time  that  such  a  general  and  unlimited  con- 
cept of  coding  will  have  been  applied. 
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12.   Recommendations  for  Further  Study. 

The  next  logical  step  in  the  study  of  a  combined  AM-PM  digital 
communications  system  would  be  either  to  simulate  a  system  on  a  computer 
or  to  build  it  as  a  breadboard  model.   It  is  felt  that  such  a  step  is 
warranted  in  the  case  of  the  system  considered  in  this  thesis. 

Because  of  the  relative  simplicity  of  this  system,  it  is  recom- 
mended that  a  working  model  of  the  system  be  designed  and  constructed 
and  a  series  of  tests  be  conducted.   These  tests  should  include  infor- 
mation rate  and  error  rate  measurements  for  a  range  of  signal  to  noise 
ratios. 

Consideration  should  also  be  given  to  the  use  of  modular  components, 
presently  available,  in  the  construction  of  this  system.   This  is  based 
on  the  fact  that,  although  the  philosophy  of  this  system  is  relatively 
new,  the  components  used  in  the  system  are  not  new. 

The  system  could  also  be  redefined  for  different,  yet  similar, 
applications  such  as  employment  over  telephone-type  lines  between  tele- 
types or  computers.   In  the  latter  application,  the  cyclic  encoder  and 
decoder  could  be  the  computers  themselves  rather  than  external  equipment. 

In  summary,  then,  the  recommendation  is  £hat  an  exact  breadboard 
model  of  the  system  be  constructed  and  tested.   Following  this,  a  model 
should  be  constructed  using  existing  modules  and  different  applications 
investigated. 
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